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DETAILED ACTION 

• Claims 1-7 and 16-20 are pending; claims 8-15 are canceled; claims 21-28 is 
withdrawn; claims 1 and 16 are amended. 

Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 1 March 
2010 has been entered. 

Response to Amendments/Arguments 

2. Applicant's amendment filed 1 March 201 0 with respect to claims 1 and 1 6 is 
entered and has been fully considered. 

3. Applicant's arguments of the rejected claims 1 , 3 and 4 under 35 U.S.C. § 1 01 
have been considered. 

a. The rejected claims are tied to a particular machine by amending the 
independent claim 1 adding "a data processing component," which meets the so 
called "tied-to-machine" requirement of 35 U.S.C. § 101 . So, the rejection will be 
withdrawn. 
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4. Applicant's arguments of the rejected claims 1,5, 16 and 20 under 35 U.S.C. § 

102 (b) have been considered, but are moot in view of the new ground(s) of rejection. 

5. Applicant's arguments of the rejected claims 2-7 and 1 7-1 9 under 35 U.S.C. § 

1 03 (a) 1 have been considered, but are moot in view of the new ground(s) of rejection. 

Priority 

6. Acknowledgment is made of the application entitled to the benefit of the filing 
date of an earlier filed US provisional application, 60/454,581 filed on 14 March 2003, 
under 35 U.S.C. 119(e). 

Claim Rejections - 35 USC § 101 

7. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

The USPTO "Subject Matter Eligibility of Computer Readable Media" (Official 
Gazette Notice 1351 OG 212 February 23, 2010, reads as follows: 

The United States Patent and Trademark Office (USPTO) is obliged to give claims their broadest 
reasonable interpretation consistent with the specification during proceedings before the USPTO. See 
In re Zletz, 893 F.2d 319 (Fed. Cir. 1989) (during patent examination the pending claims must be 
interpreted as broadly as their terms reasonably allow). The broadest reasonable interpretation of a 
claim drawn to a computer readable medium (also called machine readable medium and other such 
variations) typically covers forms of non-transitory tangible media and transitory propagating signals 



Rejection of claims 2-3, 17-18 and 21 under 35 U.S.C. 103(a) as being unpatentable over Brandle et al. ("Automatic Grid Fitting 
for Genetic Spot Array Images Containing Guide Spots") in view of Segman (US 6, 1 78,272); rejection of claims 4 and 1 9 under 35 
U.S.C. 103(a) as being unpatentable over Brandle et al. ("Automatic Grid Fitting for Genetic Spot Array Images Containing Guide 
Spots") in view of Kwon et al. (US 5,091 ,972); rejection of claims 6-7 under 35 U.S.C. 1 03(a) as being unpatentable over Brandle et 
al. ("Automatic Grid Fitting for Genetic Spot Array Images Containing Guide Spots")in view of Correa at al. (US 6,340,1 14). 
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per se in view of the ordinary and customary meaning of computer readable media, particularly when 
the specification is silent. See MPEP 21 1 1 .01 . When the broadest reasonable interpretation of a claim 
covers a signal per se, the claim must be rejected under 35 U.S.C. § 101 as covering non-statutory 
subject matter. See In re Nuijten, 500 F.3d 1346, 1356-57 (Fed. Cir. 2007) (transitory embodiments 
are not directed to statutory subject matter) and Interim Examination Instructions for Evaluating 
Subject Matter Eligibility Under 35 U.S.C. § 101, Aug. 24, 2009; p.2. 

The USPTO recognizes that applicants may have claims directed to computer readable media that 
cover signals perse, which the USPTO must reject under 35 U.S.C. § 101 as covering both non- 
statutory subject matter and statutory subject matter. In an effort to assist the patent community in 
overcoming a rejection or potential rejection under 35 U.S.C. § 101 in this situation, the USPTO 
suggests the following approach. A claim drawn to such a computer readable medium that covers 
both transitory and non-transitory embodiments may be amended to narrow the claim to cover only 
statutory embodiments to avoid a rejection under 35 U.S.C. § 101 by adding the limitation "non- 
transitory" to the claim. Cf. Animals - Patentability, 1077 Off. Gaz. Pat. Office 24 (April 21, 1987) 
(suggesting that applicants add the limitation "non-human" to a claim covering a multi-cellular 
organism to avoid a rejection under 35 U.S.C. § 101). Such an amendment would typically not raise 
the issue of new matter, even when the specification is silent because the broadest reasonable 
interpretation relies on the ordinary and customary meaning that includes signals per se. The limited 
situations in which such an amendment could raise issues of new matter occur, for example, when the 
specification does not support a non-transitory embodiment because a signal per se is the only viable 
embodiment such that the amended claim is impermissibly broadened beyond the supporting 
disclosure. See, e.g., Gentry Gallery, Inc. v. Berkline Corp., 134 F.3d 1473 (Fed. Cir. 1998). 



8. Claims 16-20 are rejected under 35 U.S.C. 101 because the claimed invention is 
directed to non-statutory subject matter as follows. Claims 16-20 recite a computer 
readable medium, which typically covers both forms of non-transitory tangible medium 
and transitory propagating signals perse under the broadest reasonable interpretation 
of the claim. Moreover, the specification does not define or disclose the details of the 
computer readable medium, which means that the computer readable medium can 
cover forms of carrier waves and transitory propagating signals under the 
broadest reasonable claim interpretation [emphasis added]. A claim drawn to such a 
computer readable medium that covers both transitory and non-transitory embodiments 
may be amended to narrow the claim to cover only statutory embodiments to avoid a 
rejection under 35 U.S.C. § 101 by adding the limitation non -transitory to the claim 
[emphasis added]. 
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Claim Rejections - 35 USC §112 

9. The following is a quotation of the second paragraph of 35 U.S.C. 1 12: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

10. Claims 1-7 are rejected under 35 U.S.C. 112, second paragraph, as being 
indefinite for failing to particularly point out and distinctly claim the subject matter which 
applicant regards as the invention. 

a. Regarding claim 1 , the claim has a limitation reciting "calculating an 
absolute location," which means calculating a single absolute location in line 7. The 
subsequent claim limitation recites "based on at least one calculated absolute location" 
(line 1 1 ), which implies one or more calculated absolute location when only a single 
absolute location was calculated in the previous claim limitation. This makes the claim 
indefinite because the calculated absolute location is just one, but the last limitation is 
reciting an absolute location having one or more, which makes the metes and bounds of 
the subject matter not distinctly defined and the claim unclear. 

b. Claims 2-7 will have the same problem with claim 1 for being a dependent 
claim of claim 1. 

Claim Rejections - 35 USC § 102 

1 1 . The following is a quotation of the appropriate paragraphs of 35 U.S.C. 1 02 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in 
public use or on sale in this country, more than one year prior to the date of application for patent in 
the United States. 
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12. Claims 1-2, 4, 6 are rejected under 35 U.S.C. 102(b) as being anticipated by 
Michael etal. (US 5,768,443). 

a. Regarding claim 1 , Michael discloses a method of fitting acquired fiducial 
data to a set of fiducials (FIGs. 6 and 9, "The inventor discloses a method of image 
distortion correction and local-to-global coordinate transformation using pixel and 
landmark" at col. 16, lines 4-12) on a fiducial plate ("semiconductor wafer" at col. 16, 
line 53) said method comprising: 

fitting a fiducial grid model to data (FIG. 6-48, "estimate camera distortion 
correction for each camera"; equations (1)-(5) and (13)-(39); "The inventor discloses 

/+ j<n i+ j<n 

fitting (computing) a function- x = G x (u,v) = J^ii'v' and y = G y (u,v) = ^b^u'v' , to a 



set of data for the correction map." at col. 7, line 40 to col. 8, line 25 and col. 12, lines 
22 to col. 15, line 40) acquired by an imaging apparatus (FIG. 1-18, 20 or 22; col. 7, 
lines 41 , "particular camera") captured such that features are positioned in space 
relative to the fiducial plate (FIG. 6-48, "estimate camera distortion correction for each 
camera"; equations (1)-(5) and (13)-(39); "The inventor discloses fitting (computing) a 



function- x = G x (u,v) = j^a u v and y = G y (u,v) = 2^b 9 u'v' that can a point of a 



observed coordinate or image coordinate {u,v} can be transform to a model coordinate 
or a physical space {x,y} at col. 7, line 40 to col. 8, line 25 and col. 12, lines 22 to col. 
15, line 40); 

establishing a conversion (FIG. 6-50; "The inventor discloses estimating the 
transformation from distortion-corrected camera coordinates or corrected local physical 
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coordinates to global physical coordinates or global coordinates" at col. 7, lines 10-39 
and col. 15, line 53 to col. 16, line 39) from acquired coordinates ("distortion-corrected 
camera coordinates or corrected local physical coordinates" at col. 7, lines 10-39 and 
col. 15, line 53 to col. 16, line 39) to ideal fiducial coordinates ("global physical 
coordinates or global coordinates" at col. 7, lines 10-39 and col. 15, line 53 to col. 16, 
line 39) using a data processing component (The MPEP teaches that [t]he express, 
implicit, and inherent disclosures of a prior art reference may be relied upon in the 
rejection of claims under 35 U.S.C. 102 or 103 2 [emphasis added]. So, "it is inherent 
that some sort of data processing component will be used for the estimation of 
transformation from distortion-corrected camera coordinates or corrected local physical 
coordinates to global physical coordinates or global coordinates because it uses 
coordinates of a point or a pixel" at col. 7, lines 10-39 and col. 15, line 53 to col. 16, line 



calculating an absolute location of identified acquired image feature centers 
("pixels associated with feature points" at col. 16, lines 57-58) relative to the fiducial 
plate in fiducial plate coordinates (FIG. 9-56, "The inventor discloses that all of the 
pixels or the pixels associated with feature points are corrected for camera distortion 
using distortion correction map. The distortion correction map has a fitting function, 



coordinate or an image coordinate {u,v} can be transformed to a model coordinate or a 
physical space {x,y}, which is a transformation or a calculation of a point or a pixel in 

2 See MPEP §21 12 



39); 




Application/Control Number: 10/800,420 Page 8 

Art Unit: 2624 

one coordinate to the other one. Moreover, it well known that a coordinate or a 
coordinate system does tell the location of a pixel or a point from the center of the 
coordinate or coordinate system." at col. 7, line 40 to col. 8, line 25, col. 12, lines 22 to 
col. 15, line 40 and col. 16, lines 54-58) using the data processing component (The 
MPEP teaches that [t]he express, implicit, and inherent disclosures of a prior art 
reference may be relied upon in the rejection of claims under 35 U.S.C. 102 or 103 3 
[emphasis added]. So, "it is inherent that some sort of data processing component will 
be used for the camera corrected distortion using a distortion correction map because it 
uses coordinates of a pixel" at col. 7, line 40 to col. 8, line 25, col. 12, lines 22 to col. 15, 
line 40 and col. 16, lines 54-58) the absolute location indicating a distance 
measurement in fiducial plate coordinates ("It well known that a coordinate or a 
coordinate system does indicate the location of a pixel or a point from the center of the 
coordinate or coordinate system, which is an indication of the distance from the center" 
at col. 7, line 40 to col. 8, line 25, col. 12, lines 22 to col. 15, line 40 and col. 16, lines 
54-58); and 

based on at least one calculated absolute location of the identified acquired 
image feature centers (col. 16, lines 57-58, "pixels associated with feature points"), 
selectively modifying a structure represented by the identified acquired image feature 
center ("It is disclosed that only pixels associated with feature points of interest are 
corrected" at col. 16, lines 57-58). 



See MPEP §21 12 
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b. Regarding claim 2, Michael discloses wherein said fitting (FIG. 6-48, 
"estimate camera distortion correction for each camera"; equations (1)-(5) and (13)-(39); 

"The inventor discloses fitting (computing) a function- x = G x (u,v) = ^ayu'v' and 



y = G y (u,v) = ]T&..wV , to a set of data for the correction map." at col. 7, line 40 to col. 

i,j>0 

8, line 25 and col. 12, lines 22 to col. 15, line 40) comprises identifying fiducial 
coordinates for each fiducial captured in said data ("[T]he landmark feature of the 
calibration target is used to establish a local origin for the corrected physical coordinate 
system" at col. 7, lines 14-16) acquired by said imaging apparatus (FIG. 1-18, 20 or 22; 
col. 7, lines 41, "particular camera"). 

c. Regarding claim 4, Michael discloses wherein said calculating (FIG. 9-56, 
"The inventor discloses that all of the pixels or the pixels associated with feature points 
are corrected for camera distortion using distortion correction map. The distortion 

correction map has a fitting function, x = G x (u,v) = ^a 9 u'V and 



y = G y (u,v) = 2^b v u'v l that can a point of an observed coordinate or an image 



coordinate {u,v} can be transformed to a model coordinate or a physical space {x,y}, 
which is a transformation or a calculation of a point or a pixel in one coordinate to the 
other one. Moreover, it well known that a coordinate or a coordinate system does tell 
the location of a pixel or a point from the center of the coordinate or coordinate system, 
at col. 7, line 40 to col. 8, line 25, col. 12, lines 22 to col. 15, line 40 and col. 16, lines 
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54-58) comprises utilizing a linear least squares operation (equations (18)-(22); 
"Singular Value Decomposition technique to solve least-squares problems ... Ax=b" at 
col. 12, line 61 to col. 13, line 27). 

d. Regarding claim 6, Michael discloses wherein said imaging apparatus 
comprising a charge- coupled device camera ("image device [] such as a CCD (charge 
coupled device)" at col. 6, lines 40-41 ). 

Claim Rejections - 35 USC § 103 

12. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

13. Claim 3 and 16-19 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Michael et al. (US 5,768,443) in view of Thompson (US 5,020,123). 

a. Regarding claim 3, Michael discloses all the previous claim limitations 
including said identifying coordinates for each fiducial ("[T]he landmark feature of the 
calibration target is used to establish a local origin for the corrected physical coordinate 
system" at col. 7, lines 14-16) and said calculating an absolute location (FIG. 9-56, "The 
inventor discloses that all of the pixels or the pixels associated with feature points are 
corrected for camera distortion using distortion correction map. The distortion correction 

map has a fitting function, x = G x (u,v) = J]a ;> .wV and y = G y (u,v) = ^b^u'v' that can 

ij>0 i,j>0 
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a point of an observed coordinate or an image coordinate {u,v} can be transformed to a 
model coordinate or a physical space {x,y}, which is a transformation or a calculation of 
a point or a pixel in one coordinate to the other one. Moreover, it well known that a 
coordinate or a coordinate system does tell the location of a pixel or a point from the 
center of the coordinate or coordinate system" at col. 7, line 40 to col. 8, line 25, col. 
12, lines 22 to col. 15, line 40 and col. 16, lines 54-58) of identified acquired image 
feature centers ("pixels associated with feature points" at col. 16, lines 57-58). 

However, Michael does not disclose a selectively iterating process. 

Instead of Michael, Thompson, the same field of endeavor of detecting image 
distortion, discloses selectively iterating process (FIGs. 2-205, 2-206, 2-207, "The 
invention shows an iterating process that fiducial marking are identified or compared 
with a predetermined tolerance" at col. 3, line 53 to col. 3, line 64). 

Michael and Thompson are combinable because both of them are related to the 
field of image distortion. 

Michael contains a "base" process of identifying coordinates for each fiducial 
as "the landmark feature of the calibration target being used to establish a local 
origin for the corrected physical coordinate system" (Michael; col. 7, lines 14-16) 
and calculating an absolute location as the step of "all of the pixels or the pixels 
associated with feature points are corrected for camera distortion using 

distortion correction map comprising a fitting function, x = G x (u,v) = ^a^v 1 and 

i,j>0 

i+j<n 

y = G y (u,v) = X&ywV that can a point of an observed coordinate or an image 

i,j>0 
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coordinate {u,v} can be transformed to a model coordinate or a physical space 
{x,y}, which is a transformation or a calculation of a point or a pixel in one 
coordinate to the other one (Michael; col. 7, line 40 to col. 8, line 25, col. 1 2, lines 22 
to col. 15, line 40 and col. 16, lines 54-58) of identified acquired image feature centers 
corresponding to the "pixels associated with feature points" (Michael; col. 16, lines 
57-58), which the claimed invention can be seen as an "improvement" in that 
selectively iterating the process of the indentifying coordinates of fiducial and 
calculating the absolute location of the image feature centers [emphasis added]. 

Thompson contains a known technique of selectively iterating process 
corresponding to the "iterating process that fiducial marking are identified or 
compared with a predetermined tolerance" (Thompson; FIGs. 2-205, 2-206, 2-207; 
col. 3, line 53 to col. 3, line 64) [emphasis added]. 

One of ordinary skilled in the art would have been recognized that applying 
Thompson's known technique of the selectively iterating process (Thompson; FIGs. 2- 
205, 2-206, 2-207, "The invention shows an iterating process that fiducial marking are 
identified or compared with a predetermined tolerance" at col. 3, line 53 to col. 3, line 
64) as applicable to the "base" process of Michael, which comprises identifying 
coordinates for each fiducial (Michael; "[T]he landmark feature of the calibration target is 
used to establish a local origin for the corrected physical coordinate system" at col. 7, 
lines 14-16) and calculating an absolute location (Michael; FIG. 9-56, "The inventor 
discloses that all of the pixels or the pixels associated with feature points are corrected 
for camera distortion using distortion correction map. The distortion correction map has 
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a fitting function, x = G x (u,v) = ^a^u'V and y = G y (u,v) = ^b^u'v' that can a point of 

i,j>0 i,j>0 

an observed coordinate or an image coordinate {u,v} can be transformed to a model 
coordinate or a physical space {x,y}, which is a transformation or a calculation of a point 
or a pixel in one coordinate to the other one" at col. 7, line 40 to col. 8, line 25, col. 12, 
lines 22 to col. 15, line 40 and col. 16, lines 54-58) of identified acquired image feature 
centers (Michael ;"pixels associated with feature points" at col. 16, lines 57-58) would 
have yielded predictable results of selectively iterating process for identifying the 
coordinates of each fiducial and calculating the absolute location of the image 
feature center, which results in an improved process such as "[providing] [a] robust 
handling of distortion and noise" (Thompson; col. 6, lines 56-57), "area identification 
...accurately performed with any number of fiducial markings ... [and] realized even in 
situations in which fiducial markings are missing or are unrecognizable" (Thompson; col. 
6, lines 59-63) [emphasis added]. 

Therefore, it would have been obvious to combine Michael and Thompson to 
obtain the invention specified in claim 3. 

b. Regarding claim 16, claim 16 recites a computer readable medium 
encoded with data and instructions, said data and said instruction causing an apparatus 
executing said instructions comprising steps equivalent to claims 1. 

Michael discloses fitting acquired fiducial data to a set of fiducials (FIGs. 6 and 
9, "The inventor discloses a method of image distortion correction and local-to-global 
coordinate transformation using pixel and landmark" at col. 16, lines 4-12) on a fiducial 
plate ("semiconductor wafer" at col. 16, line 53); 
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fit a fiducial grid model to data (FIG. 6-48, "estimate camera distortion correction 
for each camera"; equations (1)-(5) and (13)-(39); "The inventor discloses fitting 

(computing) a function- x = G x (u,v) = ^a^u'v' and y = G y (u,v) = Y^byu'v' , to a set of 

i,j>0 i,j>0 

data for the correction map." at col. 7, line 40 to col. 8, line 25 and col. 12, lines 22 to 
col. 1 5, line 40) acquired by an imaging apparatus (FIG. 1 -1 8, 20 or 22; col. 7, lines 41 , 
"particular camera") captured such that features are positioned in space relative to the 
fiducial plate (FIG. 6-48, "estimate camera distortion correction for each camera"; 
equations (1)-(5) and (13)-(39); "The inventor discloses fitting (computing) a function- 

x = G x (u,v) = ^ciyu'v' and y = G y (u,v) = J^.wV that can a point of a observed 

i,j>0 i,j>0 

coordinate or image coordinate {u,v} can be transform to a model coordinate or a 
physical space {x,y} at col. 7, line 40 to col. 8, line 25 and col. 12, lines 22 to col. 15, line 
40); 

establish a conversion (FIG. 6-50; "The inventor discloses estimating the 
transformation from distortion-corrected camera coordinates or corrected local physical 
coordinates to global physical coordinates or global coordinates" at col. 7, lines 10-39 
and col. 15, line 53 to col. 16, line 39) from acquired coordinates of each identified 
fiducial ("distortion-corrected camera coordinates or corrected local physical 
coordinates" at col. 7, lines 10-39 and col. 15, line 53 to col. 16, line 39) to ideal plate 
coordinates ("global physical coordinates or global coordinates" at col. 7, lines 10-39 
and col. 15, line 53 to col. 16, line 39); and 
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calculating an absolute location of identified acquired image feature centers (col. 
16, lines 57-58, "pixels associated with feature points") relative to the fiducial plate (FIG. 
9-56, "The inventor discloses that all of the pixels or the pixels associated with feature 
points are corrected for camera distortion using distortion correction map. The distortion 

correction map has a fitting function, x = G x (u,v) = Y^ayu'v' and 



y = G y (u,v) = JfcyiiV that can a point of an observed coordinate or an image 

coordinate {u,v} can be transformed to a model coordinate or a physical space {x,y}, 
which is a transformation or a calculation of a point or a pixel in one coordinate to the 
other one. Moreover, it well known that a coordinate or a coordinate system does tell 
the location of a pixel or a point from the center of the coordinate or coordinate system." 
at col. 7, line 40 to col. 8, line 25, col. 12, lines 22 to col. 15, line 40 and col. 16, lines 
54-58), the absolute location indicating a distance measurement in fiducial plate 
coordinates ("It well known that a coordinate or a coordinate system does tell the 
location of a pixel or a point from the center of the coordinate or coordinate system, 
which an indicate the distance from the center" at col. 7, line 40 to col. 8, line 25, col. 
12, lines 22 to col. 15, line 40 and col. 16, lines 54-58). 

However, Michael does not discloses a computer readable medium encoded with 
data and instructions, said data and said instruction causing an apparatus executing 
said instructions. 

Instead of Michael, Thompson, the same field of endeavor of detecting image 
distortion, discloses a computer readable medium (FIG. 1-103; "disk storage unit" at col. 
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2, line 44) encoded with data and instructions (FIGS. 1-102 and 103; "processing unit" 
and "memory" at col. 2, lines 43-44), said data and said instruction causing an 
apparatus executing said instructions (FIG. 1-101, "computer [being] AT&T 6386 Work 
Group System (WGS)" at col. 2, lines 42-43). 

Michael and Thompson are combinable because both of them are related to 
detecting image distortion. 

At the time of the invention, it would have obvious to a person of ordinary skill in 
the art to use the "AT&T 6386 Work Group System (WGS)" (FIG. 1-101 ; col. 2, lines 42- 
43) comprising "memory" (Thompson; FIG. 1-103; col. 2, line 43-44), "processing unit 
(Thompson; FIG. 1-120; col. 2, line 43) and a "disk storage unit (DISK)" (Thompson; 
FIG. 1-104; col. 2, line 44) of Thompson to run the steps of "estimate[ing] camera 
distortion correction for each camera" (Michael; FIG. 6-48) using fitting (computing) a 

function- x = G x {u,v) = J]a..w V and y = G y (u,v) = J^.wV , to a set of data for the 

i,j>0 i.j>0 

correction map" (Michael; equations (1)-(5) and (13)-(39); col. 7, line 40 to col. 8, line 25 
and col. 12, lines 22 to col. 15, line 40), estimating the transformation from distortion- 
corrected camera coordinates or corrected local physical coordinates to global physical 
coordinates or global coordinates (Michael; FIG. 6-50; col. 7, lines 10-39 and col. 15, 
line 53 to col. 16, line 39), and pixels or pixels associated with feature points being 
corrected for camera distortion using distortion correction map that has a fitting function, 

x = G x (u,v) = ^a^.wV and y = G y (u,v) = J^wV that can a point of an observed 

ij>0 i,j>0 

coordinate or an image coordinate {u,v} can be transformed to a model coordinate or a 
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physical space {x,y}, which is a transformation or a calculation of a point or a pixel in 
one coordinate to the other one (Michael; col. 7, line 40 to col. 8, line 25, col. 12, lines 
22 to col. 15, line 40 and col. 16, lines 54-58) taught by Michael. 

The suggestion/motivation for doing so would have yielded the predictable 
results of correcting image distortion, with no change in the original principle or 
functionality of the processing system, and thereby resulting in an improved process by 
adding benefits such as a higher computation speed and a more efficient computation. 

Therefore, it would have been obvious to combine Michael and Thompson to 
obtain the invention recited in claim 16. 

c. Regarding claim 17, Claims 17 recites a computer readable medium 
encoded with data and instructions, said data and said instruction causing an apparatus 
executing said instructions comprising steps equivalent to claims 2. 

Thompson discloses a computer readable medium (FIG. 1-103; "disk storage 
unit" at col. 2, line 44) encoded with data and instructions (FIGS. 1-102 and 103; 
"processing unit" and "memory" at col. 2, lines 43-44), said data and said instruction 
causing an apparatus executing said instructions (FIG. 1-101, "computer [being] AT&T 
6386 Work Group System (WGS)" at col. 2, lines 42-43). 

Rest of the claim limitations are analogous and correspond to claim 2. See 
rejection of claim 2 for further explanation. 

d. Regarding claim 18, Claims 18 recites a computer readable medium 
encoded with data and instructions, said data and said instruction causing an apparatus 
executing said instructions comprising steps equivalent to claims 3. 
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Thompson discloses a computer readable medium (FIG. 1-103; "disk storage 
unit" at col. 2, line 44) encoded with data and instructions (FIGS. 1-102 and 103; 
"processing unit" and "memory" at col. 2, lines 43-44), said data and said instruction 
causing an apparatus executing said instructions (FIG. 1-101, "computer [being] AT&T 
6386 Work Group System (WGS)" at col. 2, lines 42-43). 

Rest of the claim limitations are analogous and correspond to claim 3. See 
rejection of claim 3 for further explanation. 

e. Regarding claim 19, Claims 19 recites a computer readable medium 
encoded with data and instructions, said data and said instruction causing an apparatus 
executing said instructions comprising steps equivalent to claims 4. 

Thompson discloses a computer readable medium (FIG. 1-103; "disk storage 
unit" at col. 2, line 44) encoded with data and instructions (FIGS. 1-102 and 103; 
"processing unit" and "memory" at col. 2, lines 43-44), said data and said instruction 
causing an apparatus executing said instructions (FIG. 1-101, "computer [being] AT&T 
6386 Work Group System (WGS)" at col. 2, lines 42-43). 

Rest of the claim limitations are analogous and correspond to claim 4. See 
rejection of claim 4 for further explanation. 

14. Claim 5 is rejected under 35 U.S.C. 103(a) as being unpatentable over Michael 
et al. (US 5,768,443) in view of Macy et al. (US 6,538,691). 

a. Regarding claim 5, Michael discloses all the previous claim limitations 
including assuming that a rotation of said imaging apparatus (FIG. 1 -1 8, 20 or 22; col. 7, 
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lines 41, "particular camera") relative is negligible (FIG. 6-48, "estimate camera 
distortion correction for each camera"; equations (1)-(5) and (13)-(39); "The inventor 

discloses fitting (computing) a function- x = G x (u,v)= ^a^u'v' and 

y = G y (u,v) = i^byu'v' , to a set of data for the distortion correction map, which point of 

i,j>0 

an observed coordinate or an image coordinate {u,v} can be transformed to a model 
coordinate or a physical space {x,y} without considering the rotation of the camera 
relative to the coordinate " at col. 7, line 40 to col. 8, line 25 and col. 12, lines 22 to col. 
15, line 40). 

However, Michael does not disclose the fiducial grid. 

Instead of Michael, Macy, the same field of endeavor of correction of image 
distortion, discloses the fiducial grid (FIGs. 1 , 3 and 5; "camera grid (CG)" at col. 3, lines 
27-28). 

Michael and Macy are combinable because both of them are related to the field 
of image distortion correction. 

Michael contains a "base" process of assuming that a rotation of said imaging 
apparatus being negligible shown as "fitting (computing) a function- 

x = G x (u,v) = Y^ayu'v' and y = G y (u,v) = J^ii'v' , to a set of data for the 

distortion correction map, which point of an observed coordinate or an image 
coordinate {u,v} can be transformed to a model coordinate or a physical space 
{x,y} without considering the rotation of the camera relative to the coordinate" 
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(Michael; FIG. 6-48 equations (1)-(5) and (13)-(39); col. 7, line 40 to col. 8, line 25 and 
col. 12, lines 22 to col. 15, line 40), which the claimed invention can be seen as an 
"improvement" in that assuming a rotation of an imaging apparatus relative to a 
fiducial grid being negligible [emphasis added]. 

Macy contains a known technique of using a fiducial grid as a computer grid 
for displaying (Macy; FIGs. 1 , 3 and 5; col. 3, lines 27-28) [emphasis added]. 

One of ordinary skilled in the art would have been recognized that applying 
Macy's known technique of using a fiducial grid (Macy; FIGs. 1 , 3 and 5; "camera grid 
(CG)" at col. 3, lines 27-28) for displaying as applicable to the "base" process 
(Michael; FIG. 6-48, "estimate camera distortion correction for each camera"; equations 
(1)-(5) and (13)-(39); "The inventor discloses fitting (computing) a function- 

x = G x (u,v) = ^flyiiV and y = G y (u,v) = ^b 9 uW , to a set of data for the distortion 

i,j>0 i,j>0 

correction map, which point of an observed coordinate or an image coordinate {u,v} can 
be transformed to a model coordinate or a physical space {x,y} without considering the 
rotation of the camera relative to the coordinate " at col. 7, line 40 to col. 8, line 25 and 
col. 12, lines 22 to col. 15, line 40) of Michael would have yielded predictable results 
of assuming a rotation of an image apparatus relative to a fiducial grid being negligible 
for the correction of image distortion, which results in an improved process such as 
"[facilitating] the correction of digital image" (Macy; col. 3, lines 8)" and adding "greater 
computational efficiency without sacrificing accuracy" (Michael; col. 2, lines 50-51) 
[emphasis added]. 
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Therefore, it would have been obvious to combine Michael and Nancy to obtain 
the invention specified in claim 5. 

14. Claim 7 is rejected under 35 U.S.C. 103(a) as being unpatentable over Michael 
et al. (US 5,768,443) in view of Leonard et al. (US 7,034,272 B1). 

a. Regarding claim 7, Michael discloses all the previous claim limitation 
including imaging apparatus ("image device Q such as a CCD (charge coupled device)" 
at col. 6, lines 40-41). 

However, Michael does not disclose said imaging device comprising a 
complementary metal-oxide semiconductor device. 

Instead of Michael, Leonard, the same field of endeavor of calibration of the data 
measurements using coordinates, discloses said imaging device comprising a 
complementary metal-oxide semiconductor device (FIGs. 4-10 and 5-10; "CMOS 
camera" at col. 4, lines 45-49). 

Michael and Leonard are combinable because both of them are related to the 
field of calibration of the data measurements using coordinates. 

Michael contains an imaging device which differed from the claimed device by 
the substitution of the CCD camera (Micahel; col. 6, lines 40-41 ) with 
complementary metal-oxide semiconductor device [emphasis added]. Leonard 
discloses substituted device as a CMOS camera (FIGs. 4-10 and 5-10; "CMOS 
camera" at col. 4, lines 45-49), and their functions were known in the art to acquire 
an image of an object [emphasis added]. 
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One of ordinary skilled in the art could have been substituted one known 
element for another, which is substituting the CMOS camera of Leonard (FIGs. 4- 
10 and 5-10; "CMOS camera" at col. 4, lines 45-49) for the imaging device being a 
CCD camera of Michael (col. 6, lines 40-41 ), and the results of the substitution 
would have been predictable resulting in acquiring image with less power or power 
consumption, the capability of accessing the region of interest of the image by 
integrating easily with other components as it is well-known [emphasis added]. 

Therefore, it would have been obvious to combine Michael and Leonard to obtain 
the invention specified in claim 7. 

15. Claim 20 is rejected under 35 U.S.C. 103(a) as being unpatentable over Michael 
et al. (US 5,768,443) in view of Thompson (US 5,020,123) in view of Macy et al. (US 
6,538,691). 

a. Regarding claim 20, Claims 20 recites a computer readable medium 
encoded with data and instructions, said data and said instruction causing an apparatus 
executing said instructions comprising steps equivalent to claims 5. 

The combination of Michael and Thompson, as applied in claim 16, discloses all 
the previous claim limitations including a computer readable medium (Thompson; FIG. 
1-103; "disk storage unit" at col. 2, line 44) encoded with data and instructions 
(Thompson; FIGS. 1-102 and 103; "processing unit" and "memory" at col. 2, lines 43- 
44), said data and said instruction causing an apparatus executing said instructions 
(Thompson; FIG. 1-101 , "computer [being] AT&T 6386 Work Group System (WGS)" at 
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col. 2, lines 42-43) to assume that a rotation of said imaging apparatus (Michael; FIG. 1- 
1 8, 20 or 22; col. 7, lines 41 , "particular camera") relative is negligible (Michael; FIG. 6- 
48, "estimate camera distortion correction for each camera"; equations (1)-(5) and (13)- 

(39); "The inventor discloses fitting (computing) a function- x = G x (u,v) = ^a^u'v 1 and 

y = G y (u,v) = ^b^u'v' , to a set of data for the distortion correction map, which point of 

an observed coordinate or an image coordinate {u,v} can be transformed to a model 
coordinate or a physical space {x,y} without considering the rotation of the camera 
relative to the coordinate " at col. 7, line 40 to col. 8, line 25 and col. 12, lines 22 to col. 
15, line 40). 

However, the combination of Michael and Thompson does not disclose the 
fiducial grid. 

Instead of the combination of Michael and Thompson, Macy, the same field of 
endeavor of detecting image distortion, discloses the fiducial grid (FIGs. 1, 3 and 5; 
"camera grid (CG)" at col. 3, lines 27-28). 

Michael, Thompson and Macy are combinable because both of them are related 
to the field of detecting image distortion. 

The combination of Michael and Thompson contains a "base" product of 
computer readable medium as an "AT&T 6386 Work Group System (WGS)" (FIG. 1- 
101; col. 2, lines 42-43) comprising "memory" (Thompson; FIG. 1-103; col. 2, line 43- 
44), "processing unit (Thompson; FIG. 1-120; col. 2, line 43) and a "disk storage unit 
(DISK)" (Thompson; FIG. 1 -1 04; col. 2, line 44) having a step of assuming that a 
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rotation of said imaging apparatus being negligible shown as "fitting (computing) a 
function- x = G x (u,v) = J^wV and y = G y (u,v) = J^wV , to a set of data for the 

i,j>0 i,j>0 

distortion correction map, which point of an observed coordinate or an image 
coordinate {u,v} can be transformed to a model coordinate or a physical space 
{x,y} without considering the rotation of the camera relative to the coordinate" 

(Michael; FIG. 6-48 equations (1)-(5) and (13)-(39); col. 7, line 40 to col. 8, line 25 and 
col. 12, lines 22 to col. 15, line 40), which the claimed invention can be seen as an 
"improvement" in that assuming a rotation of an imaging apparatus relative to a 
fiducial grid being negligible [emphasis added]. 

Macy contains a known technique of using a fiducial grid as a computer grid 
for displaying (Macy; FIGs. 1, 3 and 5; col. 3, lines 27-28) [emphasis added]. 

One of ordinary skilled in the art would have been recognized that applying 
Macy's known technique of using a fiducial grid (Macy; FIGs. 1 , 3 and 5; "camera grid 
(CG)" at col. 3, lines 27-28) for displaying as applicable to the "base" product ("a 
computer readable medium (Thompson; FIG. 1-103; "disk storage unit" at col. 2, line 
44) encoded with data and instructions (Thompson; FIGS. 1-102 and 103; "processing 
unit" and "memory" at col. 2, lines 43-44), said data and said instruction causing an 
apparatus executing said instructions (Thompson; FIG. 1-101, "computer [being] AT&T 
6386 Work Group System (WGS)" at col. 2, lines 42-43) to assume that a rotation of 
said imaging apparatus (Michael; FIG. 1-18, 20 or 22; col. 7, lines 41 , "particular 
camera") relative is negligible (Michael; FIG. 6-48, "estimate camera distortion 
correction for each camera"; equations (1)-(5) and (13)-(39); "The inventor discloses 



Application/Control Number: 10/800,420 Page 25 

Art Unit: 2624 

fitting (computing) a function- x = G x (u,v) = ^Ta^V and y = G y (u,v) = J^-kV , to a 

zj>0 ij>0 

set of data for the distortion correction map, which point of an observed coordinate or an 
image coordinate {u,v} can be transformed to a model coordinate or a physical space 
{x,y} without considering the rotation of the camera relative to the coordinate " at col. 7, 
line 40 to col. 8, line 25 and col. 12, lines 22 to col. 15, line 40") of the combination of 
Michael and Thompson would have yielded predictable results of assuming a 
rotation of an image apparatus relative to a fiducial grid being negligible for the 
correction of image distortion, which results in an improved process such as 
"[facilitating] the correction of digital image" (Macy; col. 3, lines 8)" and adding "greater 
computational efficiency without sacrificing accuracy" (Michael; col. 2, lines 50-51) 
[emphasis added]. 

Therefore, it would have been obvious to combine Michael, Thompson and Macy 
to obtain the invention specified in claim 20. 

Conclusion 

16. No claims are allowed. 

1 7. The prior art made of record is considered pertinent to the disclosure of the 
application: 

• Smith et al. (US 4,467,21 1 ): An electron-beam array lithography (EBAL) system 
and method of operation is described. The method comprises deriving fiducial 
marking signals from a lenslet stitching grid of fiducial elements formed on a 
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standard stitching target for calibrating the boundaries of the fields of view of the 
respective lens elements of an array of lenslets. The fiducial marking signals are 
used to stitch together the individual fields of view of the lens elements in the 
array of lenslets in order to cover a desired area of a workpiece surface to be 
subsequently exposed to the electron beam, for example, the surface of a 
semiconductor wafer upon which a plurality of integrated circuit chips are to be 
formed. 

• Nonay et al. (US 6,618,494 B1): A system and method for digital x-ray imaging 
may correct distortion in a digital image by determining the cell size of a grid. A 
rotational correction may be applied to the cell to correct for distortion that might 
result from improper alignment between an imaging sensor used to capture the 
image and the image itself. Stretch factors for the pixels are calculated and 
applied to the cells of the grid to provide cells of consistent size. The calculated 
stretch factors may be applied to subsequent images to provide an efficient 
method for optical distortion correction. 

18. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to JOHN Wahnkyo LEE whose telephone number is 
(571)272-9554. The examiner can normally be reached on Monday - Friday (Alt.) 7:30 
a.m. - 5:00 p.m.. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Samir Ahmed can be reached on (571) 272-7413. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



/John Wahnkyo Lee/ 
Examiner, Art Unit 2624 



